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Abstract — The phase transition is a performance measure of 
the sparsity-undersampling tradeoff in compressed sensing (CS). 
This letter reports our first observation and evaluation of an 
empirical phase transition of the £1 minimization approach to 
the complex valued CS (CVCS), which is positioned well above 
the known phase transition of the real valued CS in the phase 
plane. This result can be considered as an extension of the existing 
phase transition theory of the block-sparse CS (BSCS) based on 
the universality argument, since the CVCS problem does not meet 
the condition required by the phase transition theory of BSCS 
but its observed phase transition coincides with that of BSCS. 
Our result is obtained by applying the recently developed ONE- 
LI algorithms to the empirical evaluation of the phase transition 
of CVCS. 

Index Terms — Compressed sensing, complex signals, l\ min- 
imization, ONE-LI algorithms, Phase transition, Joint sparsity. 



I. Introduction 

Compressed sensing (CS) aims at recovering a signal 
from reduced number of linear measurements under a spar- 
sity/compressibility condition. Different from the conventional 
linear recovery approach, a nonlinear scheme is used in CS to 
solve the following basis pursuit (BP) problem 

min llxlU , subject to Ax = b, 

X 

where x G C N is a sparse signal to be recovered, A G C nxJV 
is a sensing matrix and b G C™ is a vector of sample data, with 
TV and n being the signal length and sample size respectively 
and typically n <C TV. 

The theory of CS is mainly focused on studying how 
aggressively a sparse signal can be undersampled while still 
preserving all information for its recovery. The existing results 
include those based on incoherence H], restricted isometry 
property (RIP) J2 and phase transition theory Q. While the 
incoherence and RIP are sufficient conditions for the sparse 
signal recovery and typically quite conservative in practice 
(2), the phase transition defined for TV — > oo is most precise 
owing to its necessary and sufficient condition for measuring 
the sparsity-undersampling tradeoff performance. For the real 
valued CS (RVCS) using the sensing matrix A with i.i.d. 
random Gaussian entries, the sparsity-undersampling tradeoff 
of the BP is controlled by the sampling ratio 6 = n/N and 
sparsity ratio p = k/n, where k denotes the number of nonzero 
entries of x. As a result, the plane of (S, p) is divided by a 
phase transition curve into two phases, a 'success' phase where 
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BP successfully recovers the sparse signal and a 'failure' phase 
where the original signal cannot be recovered by solving BP, 
both with an overwhelming probability. 

In RVCS, three different approaches, combinatorial geom- 
etry J3], null space method [5| and state evolution J6), to 
the phase transition of BP have provided identical results. 
Numerical simulations have shown that the observed phase 
transition matches the theoretical curve even for modestly 
large TV, e.g., N = 1000 0, JS], where the phase transition 
for finite-TV is defined as the value of p at which the original 
signal is successfully recovered with the probability of 50%. 
Moreover, it is practically observed that the Gaussian condition 
on A can be considerably relaxed, resulting in the well known 
observed universality of phase transitions J8). 

To the best of our knowledge, the existing results on phase 
transition, before our preliminary work J9J, only deal with the 
RVCS problem. This letter presents our first study of the phase 
transition in the more general complex domain where both the 
signal and sensing matrix are complex valued. Its significance 
is twofold: 1) discovering a new phase transition for the 
complex valued CS (CVCS) so to inspire completeness of the 
phase transition theory; 2) providing insight into performance 
of numerous CS applications involving complex data, e.g., 
magnetic resonance imaging (MRI) iflOl . radar imaging ifTTI 
and source localization lfT2l . 

This letter shows that the recently developed orthonormal 
expansion l\ -minimization (ONE-LI) algorithms JTl can be 
extended to CVCS after some modifications. The algorithms 
can efficiently compute the optimal (or numerically optimal) 
solution of BP, so to provide an effective means for empirically 
exploring the phase transition of CVCS. It is observed that not 
only a transition curve exists in the phase plane of CVCS, but 
also it is well above that of RVCS. Moreover, the universality 
of phase transitions across many different matrix ensembles 
also holds in CVCS. 

The sparsity of a complex signal implies joint sparsity of its 
real and imaginary parts with the same support. This connects 
to the block-sparse CS (BSCS) problem which is to recover 
real valued signals with entries clustered into sparse blocks 
of equal size. The phase transition of the BSCS is analyzed 
in fPH by Stojnic under the condition that the null space of 
the real valued random sensing matrix is distributed uniformly 
in the Grassmanian. It is shown in this letter that the phase 
transition of the CVCS coincides with that of the BSCS with 
the block size 2. Analysis is further carried out to show that the 
phase transition of the CVCS is not a special case of that of the 
BSCS because the CVCS does not meet the aforementioned 
uniformly distributed null space condition. 

Section [II] retrospects the main points in Q on ONE-LI 
algorithms and extends the algorithms to the CVCS. Section 
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Hill applies the extended ONE-LI algorithms to explore the 
phase transition of CVCS and its connection to the BSCS. 
Conclusion is drawn in Section [IV] 

II. ONE-LI Algorithms for CVCS 

The ONE-LI algorithms Q solve the BP in RVCS where 
x, A and b are all real valued. Assume that the sensing matrix 
A is partially orthonormal, i.e., AA 1 = I with ' denoting the 
transpose and / being an identity matrix, and let T(d) be an 
operator projecting the vector d onto its first n entries. The 
orthonormal expansion technique is to introduce an expanded 
orthonormal matrix $ to reformulate the BP into 

(BP°) min M) IMIi 

^ ' subject to <&x = d and T(d) =b, 

where the first n rows of $ compose A and the rest orthonor- 
mal TV — n rows are arbitrary. 

The augmented Lagrange multiplier (ALM) method is ap- 
plied in J7) to (BP°) and the obtained result leads to an exact 
ONE-LI (eONE-Ll) algorithm for iterative computation of 
the optimal solution. While eONE-Ll has an inner iteration 
loop embedded in the outer loop iteration, its relaxed version, 
rONE-Ll, further speeds up the computation by simplifying 
the inner loop iteration into a single update. The rONE-Ll 
algorithm is numerically optimal in terms of the sparsity- 
undersampling tradeoff under reasonable parameter settings, 
i.e., its phase transition result matches that of BP. It has been 
shown that rONE-Ll is of iterative thresholding type and is 
very fast, with appropriate settings of the regulation variable, 
in comparison with other state-of-the-art algorithms. 

An important operation in the ONE-LI algorithms is the 
soft thresholding defined as 

S e {w) = sgn(w) ■ (\w\ - e)+, 

for ajfl, where e G K + , (-) + = max(-, 0) and 

, v ( w/\w\, tti^O; 

s § n W = ( 0> «, = o. 

In fact, S e (w) operates elementwisely on a real valued vector 
w. It has been well known that the soft thresholding solves 
the following l\ regularized least squares problem 

S e (w) = axgmin je H*" || x + ^ ||w - v|| 2 j (1) 

for real valued vectors w, v of the same dimension. 

To extend the ONE-LI algorithms to CVCS, the complex 
sensing matrix A G C nxN is also assumed to satisfy AA 1 = I 
with ' denoting the conjugate transpose. The soft thresholding 
operator S £ (w), for a complex vector w, is defined as in the 
real case. It is also the optimal solution to (Q]i for complex val- 
ued vectors w, v. Let K and 5 be operators taking, respectively, 
the real and imaginary parts of a variable. The augmented 
Lagrangian function in Q is modified, for the CVCS, as 

C(x,d,y, /i) = HxIIj + (d - >fx,y) + %\\d- Zx\\l , 

where y G is the Lagrange multiplier vector, p G M + 
and («i,«2) = u[u2 G C is the inner product of «i, «2 G 



C . The modified augmented Lagrangian function allows a 
straightforward extension of the derivation and optimization 
steps in Q to the complex BP problem, yielding the optimal 
solution in the same form as that of the real valued BP As 
a result, the ONE-LI algorithms can be directly applicable to 
the CVCS problem. Readers are referred to Q for detailed 
algorithm steps and the optimality and convergence analysis. 

III. Phase Transition of CVCS 
A. ONE-LI Estimation of Phase Transition of CVCS 

Section [II] has shown that the ONE-LI algorithms can be 
extended and applicable to the CVCS problem. The eONE- 
Ll achieves the optimal solution of BP and rONE-Ll is 
numerically optimal and exponentially converges, which are 
applied in this subsection to empirically explore the sparsity- 
undersampling tradeoff of BP. The implementations of ONE- 
LI algorithms follow the same procedure as their real versions 
in 0. We fix r > 1 and let pt+i = r • fit. The regulation 
parameter r is set to r = 1 + S in eONE-Ll and r = 
min (1 + 0.04(5, 1.02) is chosen in rONE-Ll. The success of 
recovering the original signal is stated if the relative root mean 
squared error (RRMSE) ||i -x°|| 2 / ||*°|| 2 < !0 -4 , where 
x° and x are the original and recovered signals, respectively. 
Meanwhile, the failure in solving BP using ONE-LI is stated 
if Hilli > (1 + 10~ 5 ) ||j*t° || x and ||x-x°|| 2 / ||*°|| 2 > 10" 4 . 

Inspired by the estimation of the real phase transition in [|6)- 
JSl, we first set a complex matrix ensemble, e.g., Gaussian, 
and dimension N. A grid of (S, p) is generated in the plane 
[0, 1] x [0, 1] with equispaced S G {0.02, 0.05, • • ■ , 0.98} and 
p G {p R (6) + 0.01(i - 21) : i = 1,2, • • ■ ,41} with respect 
to 8, where p R (S) denotes the theoretical real phase transition 
as shown in Fig. Q] For each combination of (5, p), M = 
20 random problem instances are generated and solved with 
n = \SN^ and k = \pn\. The number of success among 
M instances is recorded. After data acquisition, a generalized 
linear modal (GLM) with a logistic link is used to estimate 
the phase transition. 

We now explore the sparsity-undersampling tradeoff of BP 
with partial-Fourier sampling. Four values of signal length N 
are considered, including 1024, 2048, 4096 and 8192. When 
N = 1024, both eONE-Ll and rONE-Ll are used to estimate 
the phase transition of BP. The rONE-Ll algorithm is used 
for other N. Few failures in solving the BP occur when using 
rONE-Ll. Fig. [T] presents the estimated phase transitions of 
partial-Fourier sampling. The five observed phase transitions 
of BP, estimated respectively by eONE-Ll with N = 1024 and 
rONE-Ll with N = 1024, 2048, 4096 and 8192, coincide with 
each other and are higher than the real phase transition of BP. 
Our earlier observation of the successful signal recovery rate 
reported in Q also showed that a larger TV results in sharper 
phase transition. Hence, we can state: 

Finding 1: For complex signals and the partial-Fourier ma- 
trix ensemble with large dimension TV, we observe that 

I. BP exhibits phase transition in the plane of (6, p), and a 

larger TV can result in a sharper phase transition. 
II. the complex phase transition of BP is higher than the 
real phase transition with a considerably enlarged success 
phase. 
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Fig. 1 . Observed phase transitions of partial-Fourier sampling. The upper five 
curves are observed phase transitions estimated by eONE-Ll with N = 1024 
and rONE-Ll with N = 1024, 2048, 4096 and 8192, respectively. The lower 
is the theoretical real phase transition of BP. 



Fig. 2. Observed universality of phase transitions of BP in the complex 
domain. The signal length N = 8192 for partial-Fourier matrix ensemble 
and N = 1000 for the other three matrix ensembles. 



B. Universality of Phase Transitions of CVCS 

The observed universality of phase transitions of BP in the 
real case has been discussed in |8 1 and the same result is stated 
in J6), El- In this subsection, we examine whether the same 
property holds in the complex case. Apart from the partial- 
Fourier matrix ensemble, three other complex matrix ensem- 
bles are considered with signal length N = 1000, including 
Gaussian, Bernoulli and Ternary. All random matrices have 
i.i.d. real and imaginary parts following the corresponding 
distributions. Bernoulli refers to equally likely being or 1, 
and Ternary is equally likely to be — 1, or 1. It is noted that 
a matrix generated from these matrix ensembles may not be 
partially orthonormal as required by the ONE-LI algorithms. 
This problem can always be resolved by left multiplying both 
sides of Ax = b with an invertible matrix, e.g. using QR 
decomposition, so the transformed equation meets the partially 
orthonormal condition and preserves the same solution space. 

Few failures in solving BP occur in our experiment. Fig. [2] 
presents the observed phase transitions of BP with different 
matrix ensembles. Like the universality of phase transitions in 
the real case, we have the following finding. 

Finding 2: For complex signals and a number of complex 
matrix ensembles with large dimension N, BP exhibits the 
same phase transition. 



C. Connection of CVCS and BSCS 

The complex system Ax 
valued formulation as A r x r = b r with A r = 



and b r = 



b can be rewritten into a real 

qa m y 

By the fc-sparsity of x, $ix and 3* 

are jointly fc-sparse, in the sense that they are both fc-sparse 
and share the same support. On the other hand, after proper 
permutations of entries of x r as well as the corresponding 
columns of A r , A r x r = b r can be recast into a BSCS problem 



m 

9* 



|[T3l with block size 2. The blocked signal of x r is fc-block- 
sparse with at most k nonzero block entries and its ^2,1-norm 
as defined in [ 1 3 1 is equivalent to the t\ norm of x in the 
CVCS. Thus the CVCS problem is strongly connected to the 
BSCS problem via the real valued reformation A r x r = b r . 
Their only difference is that A r is subject to a structured 
constraint whereas entries of the sensing matrix of the BSCS 
problem are independent in general. 

A comparison of the phase transition of CVCS with the- 
oretical phase transition of BSCS with block size 2 in lfl3l 
is presented in Fig. [3] It is shown that the observed phase 
transition of CVCS coincides with that of BSCS. 

In ff3l . the theoretical phase transition of BSCS is derived 
under the condition that the null space of the real valued 
random sensing matrix is distributed uniformly in the Grass- 
manian with respect to the Haar measure. It is known that 
the real Gaussian matrix ensemble satisfies such a condition 
|[T4| . We now provide an analysis in the following proposition 
to show that such a condition is not satisfied in the CVCS 
problem. It therefore clarifies that the phase transition of the 
CVCS studied in this letter is not a special case of the phase 
transition result of BSCS in lfl3l . 

Proposition 1: For any complex random matrix A associ- 
ated with the CVCS problem, the null space of A r is not 
distributed uniformly in the Grassmanian with respect to the 
Haar measure. 

Proof: Let J\f (A r ) denote the null space of A r . Sup- 



pose 

— v 
w 



pN 



It is obvious that 



e Af(A r ) with w,v e 
€ Af (A r ) and thus it is always possible to choose a basis 
for J\f (A r ) in the form 



(columns of W + jV € 



W V 
V w 

••Nx(N-n) 



with W,V e R Nx ( N ~ n ) 
in fact compose a basis 



for the null space of A). As a result, N (A r ) is not distributed 
uniformly in the Grassmanian. ■ 
Proposition[T]shows that the existing phase transition theory 
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Fig. 3. Coincidence between our observed complex phase transition and 
the block-sparse phase transition with block size of 2. The indirect phase 
transition curve refers to minimizing ||x r ||i subject to Ax = b. 

of BSCS cannot explain our obtained empirical phase transi- 
tion of the CVCS. Intuitively, the coincidence of the phase 
transition of CVCS with that of BSCS may be interpreted as 
the universality of phase transitions of BSCS across different 
matrix ensembles. Fig. [3] also shows that the observed phase 
transition by minimizing ||jc r |li> subject to Ax = b and without 
taking into account the block-sparsity, matches the real phase 
transition of BP. It further explains that the higher successful 
rate of CVCS is obtained by incorporating the block-sparsity 
factor into its problem solving. 

In the above, it has been shown that the CVCS problem 
is connected to BSCS with a special structure of the sensing 
matrix A r , It is interesting to consider that the sensing matrix 
in CVCS is further specialized into a block-diagonal matrix, 
i.e., 3A = in A r or, equivalently, A E W nxN . Such a 
case refers to the jointly sparse CS or the case of multiple 
measurement vectors (MMV). In comparison with the standard 
real CS or the case of single measurement vector (SMV), 
the recovery performance can be improved in the MMV case 
under some assumptions on the distribution of entries of x fl5l . 
On the other hand, the analysis of the null space property in 
lfl6l shows that there is little performance improvement in the 
worst case of signal recovery, such as an x with identical real 
and imaginary parts. So, in this special case of jointly sparse 
CS, the observed universality of phase transitions of BSCS 
does not hold. 

IV. Conclusion 

In this letter, the sparsity-undersampling tradeoff of BP for 
the CVCS problem is empirically explored in terms of the 
phase transition. It is found that the same properties exist as 
those in the RVCS case, such as the existence of the phase 
transition and observed universality across different matrix 
ensembles. The empirical phase transition of CVCS presents 
larger successful phase than that of RVCS, indicating that more 
successful recoveries of complex signals can be achieved by 
incorporating the signal structure into the problem solving 



process. It is shown that the empirical phase transition of 
CVCS is connected to and coincides with that of BSCS 
with block size 2. It is however not a special case of the 
existing phase transition theory of BSCS and can be intuitively 
interpreted as an extension of current results based on the uni- 
versality argument. So far, the rigorous relationship between 
the phase transitions of CVCS and BSCS problems is still an 
open problem. It is finally noted that an analysis, based on a 
different algorithm, of the existence of the phase transition of 
CVCS and its expression that agrees with the results in this 
letter has been reported in ifTTll during the preparation of this 
letter. 
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